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Abstract 

Background: Research on psychological risk factors for injury has focused on stable traits. Our objective was to test the 
feasibility of a prospective longitudinal study designed to examine labile psychological states as risk factors of injury. 

Methods: We measured psychological traits at baseline (mood, ways of coping and anxiety), and psychological states 
every day (l~item questions on anxiety, sleep, fatigue, soreness, self-confidence) before performances in Cirque du Soleil 
artists of the show "0". Additional questions were added once per week to better assess anxiety (20-item) and mood. 
Questionnaires were provided in English, French, Russian and Japanese. Injury and exposure data were extracted from 
electronic records that are kept as part of routine business practices. 

Results: The 43.9% (36/82) recruitment rate was more than expected. Most artists completed the baseline 
questionnaires in 15 min, a weekly questionnaire in <2 min and a daily questionnaire in <1 min. We improved 
the formatting of some questions during the study, and adapted the wording of other questions to improve 
clarity. There were no dropouts during the entire study, suggesting the questionnaires were appropriate in 
content and length. Results for sample size calculations depend on the number of artists followed and the 
minimal important difference in injury rates, but in general, preclude a purely prospective study with daily data 
collection because of the long follow-up required. However, a prospective nested case-crossover design with data 
collection bi-weekly and at the time of injury appears feasible. 

Conclusion: A prospective study collecting psychological state data from subjects who train and work regularly 
together is feasible, but sample size calculations suggest that the optimal study design would use prospective 
nested case-crossover methodology. 

Keywords: Epidemiology, Injury, Psychological risk factors. Prospective 



Background 

Participation in physical activities is associated with an 
increase in quality of life [1], enhanced academic per- 
formance [2-4], a positive impact on behavior [5-7], bet- 
ter mental health [8], better physical health [9,10], and 
decreased obesity [11]. Despite its benefits, an increase 
in physical activity is also associated with an increased 
injury risk. An estimated 20.6 million children are in- 
jured each year in the USA [12], and 559,000 in Canada 
[13]. Of those receiving medical attention for sports and 
recreation related injuries in the US, one fifth of school- 
children and more than one quarter of working adults 
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experience one or more days of lost time from school or 
work [14]. In addition to these short-term effects, in- 
jured athletes may have an increased risk of long-term 
sequelae such as osteoarthritis with concomitant reduc- 
tion of physical capacity [15-17]. A better understanding 
of the causes of sport injuries and their recurrences can 
therefore have a significant impact on athlete health and 
associated care costs. 

In addition to physical, equipment, or procedural causes 
of activity-related injuries, psychological risk factors may 
play an important role. Although early psychological re- 
search was often limited to theoretical tests of single vari- 
ables (e.g., personality) more recent work has utilized a 
multi-variable stress and sport injury model [18]. Some 
findings indicate the experience of stressful life events can 
increase injury rates [18,19], although its impact varies 
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across sports [20] and is often moderated by social sup- 
port and coping styles [20,21]. Subsequently, other re- 
searchers amended the theory and utilized a variety of 
different scales to assess life events and coping, focusing 
on either sport or athletes [22] . 

Despite this work, a literature review found only "lim- 
ited scientific knowledge" [20] while suggesting that 
situational-dependent emotional states can also influ- 
ence injury. Although high anxiety may worsen per- 
formance and increase the risk of injury, its impact is 
quite variable among athletes, even among those with 
similar skills competing in the same event [23,24]. 
Studies based on Hanin's Individual Zones of Optimal 
Functioning (IZOF) [23] have found that 25-45% of ath- 
letes actually require high anxiety to achieve good or 
optimal performances, yet to date no prospective re- 
search has examined sport injury using this perspective 
(one study used a retrospective design [25]). 

Unpleasant moods are also associated with increased 
injury risk [20,26]. However, these authors utilized a sin- 
gle baseline assessment of mood, often with a consider- 
able lag time between psychological assessment and 
injury. Assessment of mood at regular intervals would 
be far more efficacious given the dynamic nature of ath- 
letic training load, mood disturbance [27], and overtrain- 
ing syndrome [27,28] . Depression, irrespective of whether 
it is the consequence of a negative life event (e.g., divorce) 
or is sport related (e.g., overtraining), would be expected 
to compromise the ability to concentrate and focus [29], 
and therefore increase injury risk [30]. 

Other psychological variables associated with injury in- 
clude bodily self-perceptions (e.g., fatigue) [31], coping 
skills and life events [32], again assessed with only lim- 
ited longitudinal research. Fawkner and colleagues [33] 
assessed daily hassles in 98 athletes weekly over a 13- 
week season. Injured athletes reported increased hassles 
in the week prior to injury compared with uninjured 
athletes, but the analysis grouped participants by out- 
come and then observed exposures without considering 
that both exposure and covariates varied over time, a 
known source of potential bias [34,35]. Ivarsson and col- 
leagues conducted two studies that included assessing 
whether the Daily Hassles Questionnaire predicted in- 
jury in Swedish Division 4-6 (competitive) and Premier 
League (professional) soccer players who completed the 
questionnaire weekly over a three-month period [36,37]. 
Unfortunately biases may have been introduced because 
the analyses could not account for time-varying nature 
of exposure or other covariates, and did not assess any 
state constructs aside from the Daily Hassles Question- 
naire. In a third study on elite junior soccer players [38], 
the same group found differences in a trajectory analysis 
comparing Daily Hassles and Uplifting events among in- 
jured and non-injured subjects. 



These initial studies have been informative, but there 
are important limitations to the methods that were used 
to address the role of psychological states that are be- 
lieved to change frequently over time when the outcome 
is injury. These are explained below in more depth but 
in brief, analyses that compare scores for injured versus 
non-injured subjects address the question whether psy- 
chological factors differ between these two groups, ra- 
ther than whether the varying psychological states 
within an individual affect injury risk. Because psycho- 
logical states will correlate with psychological traits (and 
psychological traits are risk factors for injury), the above 
analyses did not address the question we are posing. If 
the psychological state is truly a risk factor within an in- 
dividual, then psychological interventions on the day of 
competition would be promising to explore. Otherwise, 
one should focus on longer-term interventions that ad- 
dress the more stable psychological traits that have 
already been identified as risk factors (although differen- 
tiating causal from non-causal risk factors remains to be 
determined). 

Injury research strategies to minimize bias 

When time-varying exposures and covariates are consid- 
ered important, one could use two general approaches 
to minimize bias. First, one could ask patients to recall 
how they felt before the injury. The control group could 
consist of non-injured participants at the time of injury 
(case-control study, where control participants are sam- 
pled at the time a case is diagnosed, and therefore can 
later be considered cases), or the same participants recal- 
ling their "states" a few days earlier (i.e., case-crossover 
study) [35]. However, these study designs are subject to 
potential recall biases. 

Alternatively in a prospective design one measures 
psychological variables regularly (e.g. daily or weekly), 
where the analytical approach could be a longitudinal 
repeated-measures design (e.g. time-series) or a nested 
case-crossover analysis. In this approach sample size re- 
quirements are dependent on both the frequency of in- 
jury events and the correlation of psychological states 
over time (higher sample sizes if states are relatively 
stable because there is less information on the changing 
exposures). However, this option involves logistical chal- 
lenges associated with frequent collection of psycho- 
logical data. Some psychological questionnaires may 
evoke scepticism among athletes, staff and coaches [39], 
and there may be variations due to translation [40], need 
to minimize time commitment [40,41], sport context, 
and participants' understanding for the need to avoid re- 
sponse distortion (either faking good or bad) [42]. Com- 
pleting daily questionnaires may result in fatigue, with 
answers provided in an unvarying or random manner 
[43], or drop-out. There are also challenges in managing 
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daily data collection, and transmitting it to a central data 
management unit in any sport setting. Therefore, it is 
paramount to establish procedures and practices that fa- 
cilitate these processes. 

As a consequence, the primary objective of this pilot 
study was to test the feasibility of a prospective study 
specifically designed to test if psychological states are 
predictive of injury. More specifically, our objectives 
were to determine 1) time required to complete psycho- 
logical questionnaires distributed at baseline (assessing 
traits), daily (assessing states), and once per week (asses- 
sing states including an additional questionnaire to as- 
sess mood); 2) optimal distributing and collecting of 
questionnaires to be completed daily or once per week; 

3) questionnaire comprehension and acceptability and; 

4) intra-individual correlation for daily psychological states 
necessary for sample size calculations in a larger longitu- 
dinal repeated-measures investigation. 

The study population were artists from the show "O" 
produced by Cirque du Soleil (CDS). These artists come 
from a variety of athletic backgrounds including swim- 
ming, diving, gymnastics and acrosport, as well as per- 
forming arts including dancers and musicians. We chose 
this population because injury records and exposures are 
stored electronically, and conducting the study appeared 
feasible. Overall injury rates have been estimated to be 9.7 
injuries per 1000 artist-exposures (similar to Men's NCAA 
Basketball [44]), with 4.4% of injuries resulting in missing 
15 or more performances (approximately equivalent to 
10 days) [45]. We therefore expect these results to be use- 
ful in other athletic contexts involving regular psycho- 
logical assessments for an extended period. 

Methods 

Preliminary study development 

The McGill University Institutional Review Board ap- 
proved this pilot study. The questionnaires could only 
cover a limited number of constructs because participants 
were required to complete them daily. To determine 
which constructs we should investigate in our context (see 
Table 1), we used an iterative process. We first individually 
interviewed CDS personnel that were familiar with circus- 
related injuries: Director of Performance Medicine re- 
sponsible for shows that change location, Director of 
Performance Medicine responsible for shows that don't 
change location, the head coach, a choreographer, a super- 
vising physiotherapist for one show, and the Senior 
Performance Psychologist. Following these meetings, we 
outlined areas of interest, their potential mechanisms of 
action, and identified corresponding psychological con- 
structs. These variables and constructs were later verified 
with the same CDS personnel. 

Table 1 illustrates the constructs identified as most 
likely to be important through the interviews with CDS 



personnel and a review of the literature, questionnaires 
chosen from the literature where they existed, and tim- 
ing/frequency for questionnaire distribution. The con- 
structs included trait and state anxiety, trait ability to 
cope, trait and state mood, and state confidence, where 
traits were measured at baseline and states were mea- 
sured daily. We also included questions related to sev- 
eral state behavioural habits believed to influence injury 
risk. Our objective was to have artists complete the base- 
line questionnaires within 15 min, weekly questionnaires 
within 2 min and daily questionnaires within 1 min. De- 
tails of the specific questionnaires are described below. 

Recruitment 

Approximately one month prior to the study, we 
approached all CDS artists > 18 years of age working at the 
show "O" located in Las Vegas, Nevada. During a regular 
weekly meeting, we gave a brief 10-min presentation 
explaining the general principles of the study, and distrib- 
uted consent forms. We emphasized that we could prepare 
reports for each individual showing how their daily profiles 
changed over time. In addition, because artists often rely on 
each other (e.g. catcher and flyer in a trapeze act), we em- 
phasized that the information may be important to the 
team, even if the individual did not feel it was personally im- 
portant (which would be analogous in some team sport con- 
texts). Artists were asked to submit signed consent forms 
within one week if they were interested in participating. 

Questionnaire timing and processes 

We provided the questionnaires in the four principal 
languages of the artists: English, French, Japanese and 
Russian. We used existing translations where available, 
and used the professional CDS translation service when 
necessary. At least one artist with conversational English 
language skills and whose first language was the translated 
language reviewed all translated questionnaires. Although 
we recognize that cultural differences exist between popu- 
lations using these languages that might increase the het- 
erogeneity of responses between participants, this should 
not affect our ability to reach our primary objectives of de- 
termining feasibility, and variance estimates for sample 
size calculations of a definitive study. 

After discussions with the stage manager and artistic 
directors, baseline questionnaires including State-Trait 
Anxiety Inventory (STAI) [50], Ways of Coping [40,47] 
and Profile of Mood States (POMS) [48] were distrib- 
uted at the time the artist provided informed consent, 
and were completed at home over the ensuing 2-4 
weeks. On each working day, we placed a short "states" 
questionnaire (see Additional file 1) that included either 
7 or 9 items (i.e. 2 additional questions included on the 
"weekly" questionnaire) at each artist's make-up station 
(each had their own station). The items included in 
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Table 1 Constructs and associated questionnaires used to measure traits and states 



Construct 



Questionnaire 



Timing 



Traits 



Anxiety 



Ability to cope, Frustration 



Complainers, Unliappiness 
States 

Conflicts, Anger, Frustration 

Anxiety 
Anxiety 

Self-Confidence 
Poor sleep 



Physical capacity 



STAI-Y2 [46]: A validated 20-item questionnaire. 

STAI-Y1 Best [40]: A validated 20-item questionnaire measuring state anxiety relative to the time the artist had Baseline 
their best performance. 

Ways of Coping [47]: A validated 66-item questionnaire to identify the thoughts and acts used to cope in a 
specific stressful event. There are eight sub-scales in the student-sample scoring we used (problem focused, 
wishful thinking, detachment, seel< social support, focusing on the positive, self blame, tension reduction and 
keeping to oneself). We chose the student sample scoring system because we felt that the problems associated 
with a production company environment (e.g. changeover of personnel, deadlines, new training) are more closely 
related to what students experience compared to a sample of stable community workers. 

Profile of Mood States (POIVIS) [48]: A validated 65-item questionnaire that includes subscales for tension, 
depression, anger, vigour, fatigue and confusion. There is considerable evidence that this global measure of ggsejine 
mood disturbance is closely associated with the stress of athletic training [49] as well as relative success in 
athletics and other realms of performance with a significant physical component [30]. 



Baseline 



Training Distress Scale [41]: A validated 7-item 5-point Likert scale questionnaire assessing specific and general 
mood states. Items generally come from the Profile of Mood States [48] Other items related to the construct 
of anger/frustration (identified by CDS management identified as potentially important) include "bad-tempered" 
and "peeved". 

STAI-Yl [50]: A validated 20-item questionnaire measuring state anxiety. 
Single-item Likert question [51]. 

Single-item 7-point Likert question [52]: This question examines an artist's confidence about their upcoming 
performances that day. Variations of this single item are considered valid alternatives to more time consuming 
assessments of self-confidence [53], and are associated with anxiety and performance [52]. 

Single-item Likert question [49]. 

Fatigue: We used a 1-item validated question [54]. 

General well-being: We used a 7-item Likert scale question (from Very very good to Very very bad) [49]. 
Sleep: 1 -item questionnaire about the amount and quality of sleep [49]. 
Sickness within the last 24 hours. 

Muscle soreness: 7-item Likert scale questions from Very Very Good to Very Very Sore [42,49] for whole body, 
legs and arms. The responses to these items have been found to be correlated to both more comprehensive 
psychological questionnaires [49], biological markers of stress such as Cortisol [42] and objective measures of 
athletic performance [55]. 



Weekly 

Weekly 
Daily 

Daily 

Daily 



Daily 



these questionnaires came from validated questionnaires 
where possible and included the constructs conflicts, 
anxiety, self-confidence, sleep and physical capacity 
(Table 1). Artists completed the questionnaire prior to 
the day's performances, and dropped them into a locked 
drop-box or handed them to the supervising therapist. 
To minimize missing data, distributed questionnaires in- 
cluded the date and the artist's identification number. 
Completed forms were scanned and emailed to the pri- 
mary investigator for data entry. 

Artists were encouraged to provide feedback through- 
out the study, with special reference to the time required 
to complete questionnaires, undesirable questions, logis- 
tical problems, workload, and possible duration for a de- 
finitive study. 

Injury and exposure data 

To track injury and exposure data, we used the same 
methods as our previous studies [45]. In brief, CDS 



therapists use electronic charting for all injuries and 
treatments (provided free of charge to artists) through 
in-house injury tracking software. We classified injuries 
according to commonly used criteria in the sport injury 
literature [56-58] and we have used in the past with the 
same company [45] and are common in sport medicine 
epidemiology: Ivledical Attention (injury reported to a 
show therapist) and Time-Loss -1 (TL-1) if the injury re- 
sulted in at least one missed performance. Anytime an 
artist misses a performance, it must be documented as 
either a work-related injury (included in our analyses 
and for which the artist is covered by health insurance), 
or a personal health condition (excluded from our ana- 
lyses). Exposure data were obtained from in-house soft- 
ware that keeps track of when artists are performing. 

Analyses 

As a pilot study designed primarily to assess feasibility, 
we provide descriptive statistics only. For continuous 
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variables, we report the median and interquartile region 
(IQR) because the data were skewed, and we report per- 
cent for categorical variables. In addition, we report the 
direct feedback elicited during weekly meetings. Our 
sample size was determined by the number of artists 
within the show and was not modifiable. For practical 
considerations due to vacation time, we used an 8-week 
period that began one week after a vacation and ended 
within two weeks of the next vacation. 

To calculate sample sizes for the definitive study, we 
used linear mixed models and generalized estimating 
equations (GEE) to account for the intra-participant cor- 
relations for the psychological variables over days (stabil- 
ity of states across time), and took a precision-based 
approach for the estimate via simulations based on psy- 
chological daily data that corresponded to our observed 
data. The observed injury rates (shown in results) were 
much less than previous studies in the general CDS 
population. Given the short time frame of the pilot 
study, we felt the results from our previous study would 
provide a more reliable estimate. We estimated a baseline 
TL-1 injury rate of 1.6 injuries per 1000 artist-exposures 
for the company [45], and a minimal important difference 
(MID) of 25% (i.e. 1.2 injuries per 1000 artist-exposures). 
We calculated sample sizes based on at least a 2-category 
change in an ordinal scale (all daily questions used essen- 
tially ordinal data). We varied the number of artists (be- 
tween 180-1000) and the number of observation days 
(40-250) to explore different assumptions (always setting 
alpha to 0.05, 2-sided). All simulations and calculations 
were conducted in the open-software R [59] with the lme4 
[60] and geepack [61] libraries. In addition, we estimated 
sample size for a case-crossover study using a matched 
case-control design using free open source statistical soft- 
ware [62] and the following parameter values: 2-sided 
alpha = 0.05, power = 0.8, 10:1 ratio of controls to cases, 
risk of exposure (categorized dichotomously) in controls 
at 0.3, and an MID of 25% and 50% increased risk of ex- 
posure in cases. 



Results 

Of the 82 artists approached, 42 initially expressed interest. 
However, three declined after receiving the baseline ques- 
tionnaires, and two took personal leave of absences before 
the study began, leaving 16 females and 21 males recruited 
for the study (45.1% recruitment). Artists' region of origin 
included Canada, United States, Australia, Europe, Russia, 
and Asia. One of our four translations represented the first 
language of the artist in 31/37 artists, second language in 
5/37 artists, and third language in 1/37. The median age 
was 32.4 (IQR: 29.2 to 37.9). We received feedback evalua- 
tions from 31/37 participating artists. The mean values for 
the baseline psychological questionnaires are provided in 



Table 2 for the 33 participants where there were no miss- 
ing answers. 

Distributing and collecting questionnaires 

To facilitate the process, identification numbers on 
questionnaires were numbered in the same order as the 
participating artists' make-up tables, but were not se- 
quential (i.e. two proximal artists might be 63 and 66) in 
order to enhance confidentiality. Distributing the question- 
naires required ~10 min and was usually done ~2 hours 
before the night's first performance. In general, feedback 
from the artists suggested the ability to simply drop com- 
pleted questionnaires in a locked box located near the 
door was well received. 

Time to complete questionnaires 

The baseline questionnaire was completed in the tar- 
geted time (<15 min) by more than 60% of artists but 
required more than 30 min by two artists. We expected 
the weekly questionnaire to be completed in <2 min 
and the daily questionnaire to be completed in <1 min, 
but -20% of artists required more time. That said, 45- 
50% of the artists required less than half the expected 
time. When we cross-correlated the results from the differ- 
ent questionnaires, the two participants requiring >30 min 
for the baseline questionnaire were not the same partici- 
pants requiring longer periods for the weekly or daily ques- 
tionnaires. Of the seven participants requiring >2 min for 



Table 2 Mean (sd) for each of the psychological 
questionnaires administered at baseline* 



Questionnaire 


Subscale 


Mean (sd) 


STAI-Y1 




37.5 (124) 


STAI-Y1 (Best) 




31.6 (10.2) 


STAI-Y2 




38.8 (10.8) 




Tension-Anxiety 


14.7 (6.6) 




Depression-Dejection 


7.9 (9.1) 




Anger-Hostility 


8.8 (7.9) 


POMS 






Vigor 


20.0 (5.4) 




Fatigue 


91 (5.7) 




Confusion-Bewilderment 


1 2.2 (4.4) 




Problem focused 


20.2 (5.2) 




Wishful thinking 


7.1 (3.7) 




Detachment 


8.3 (3.8) 




Seek social support 


10.9 (4.7) 


Ways of coping 




Focusing on the positive 


7.9 (2.6) 




Self blame 


47 (2.1) 




Tension reduction 


3.6(1.5) 




Keep to self 


3.9 (1.8) 


*Values represent means 
except for STAI-Y2 where 


for participants who had no missing values: n = 34 
n = 32. 
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the weekly questionnaire, the time required for the daily 
questionnaire was <30 s for two artists, between 31-120 s 
for three artists, and >2 min for two artists. 

Acceptability and comprehension of the questionnaires 

There were no questions that artists felt should not be 
asked. No artist felt the workload onerous, but a couple 
of artists felt it was bothersome to answer the same 
questions daily. Of the 26 participants who answered 
how much longer they would be willing to continue 
completing the questionnaires if the study was repeated, 
five responded as long as needed, five responded -2-3 
months, two responded one month, two simply said they 
would continue for now, three were unsure and nine 
said they would no longer continue. 

Based on artist feedback, we made important changes to 
the text and format of the daily questionnaire within the 
first couple of weeks (see Additional file 1). The original 
versions of questions 5 and 6 were re-worded to clearly in- 
dicate they referred to the upcoming performance not yet 
done. We also added "current role" to question 6 to clearly 
indicate we were interested in the optimal level of anxiety 
relevant to their current role at CDS. 

Despite our encouragement for feedback, the first 
question of the daily questionnaire (overall well-being, 
"How do you feel today?" with 7-point Likert response 
from Very very good to Very very bad) was left un- 
answered on 68/1297 collected questionnaires; several 
artists provided feedback saying it was difficult to give 
an "overall" assessment. The question regarding sleeping 
was left unanswered 42/1297 times, likely due to ques- 
tionnaire formatting because we did not receive any 
comments. We believe adding a dotted line from the 
question to the answer choices might draw the artists' 
eyes to the question-answer group. 

Injuries during pilot study 

Over 2660 artist-performances, there were a total of nine 
Medical Attention injuries (3.4 injuries per 1000 artist- 
performances) and three TL-1 injuries 1.1 TL-1 injuries 
per 1000 artist-performances. 

Sample size calculations 

Intra-participant correlations were higher than expected, 
and three artists had no variability within the study for 
some psychological factors. With the low TL-1 injury 
rate and low variability, sample size calculations for both 
the linear mixed and GEE models were very high, with 
the linear mixed model predictably showing slightly less 
power than the GEE results. For example, using 180 art- 
ists measured over 100 days would provide only 13% 
power under a GEE model. Increasing the number of 
artists to 1000 only increases power to 30%. Increasing 
the number of days of observation increases power as 



well, but following 750 artists for 250 days yields only 
30% power, and following 1000 artists for 250 days yields 
only 61% power. 

Based on these results, we consider it infeasible to reli- 
ably follow participants daily for so long. Therefore, we 
also calculated the sample size for a case-crossover study 
where we would measure artists only once or twice per 
week, and then again post-injury. Based on the parame- 
ters discussed in the methods, and the estimated intra- 
participant correlations ranging from 0.16 to 0.58 for the 
different variables measured (Table 3), we would need 
between 828 and 1301 cases (injuries) if the MID is 25% 
increased risk. The number of artist-performances needed 
to occur is equal to the required number of cases divided 
by the injury rate per 1000 artist exposures. With an ex- 
pected TL-1 injury rate of ~1.5 per 1000 performances 
one would need to follow between 550,000 (for "ill past 
24 hours") to 870,000 artist-performances (for "confi- 
dence"). With recruitment similar to our pilot study of 35 
artists per show on six shows (210 artists) and assuming 
an average of 470 performances per year, we would need 
to follow the artists between 67-105 months. If the MID 
is 50% increased risk, the number of cases and artist- 
exposures is greatly decreased (to -30% of the above 
values), but we would still need to follow artists for 20-32 
months. 

If instead one were interested in medical attention 
injuries, the estimated injury rate from previous studies 
is -10 per 1000 performances. In this context, we would 
need to follow 210 artists for -10-16 months (82,800 to 
130,1000 artist performances) for an increased risk of 
25%, but only - 3-5 months (24,200 to 38,900 artist per- 
formances) for an increased risk of 50%. Increasing the 



Table 3 Estimated Intra-class correlations (ICC)^ and 
calculated sample sizes^ for variables measured daily 
over the entire study 



Variable 


Estimated 
fCC^ 


Estimated 
sample size^ 


Feeling today 


0.35 


950 


Hours slept 


0.34 


941 


III past 24 hours 


0.16 


828 


Whole body soreness 


0.41 


1011 


Art soreness 


0.46 


1075 


Leg soreness 


0.40 


1000 


Confidence 


0.58 


1301 


Anxiety 


0.56 


1254 


Fatigue 


0.32 


924 



^ICC was calculated as within subject variance/total variance within a linear 
regression random effects model. 

^Sample sizes calculated using matched case-control design and the following 
parameter values: alpha = 0.05, power = 0.8, 1 0:1 ratio of controls to cases, risk 
of exposure (categorized dichotomously) in controls at 0.3, and an increased 
risk of exposure in cases at 20%. 
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number of artists through improved recruitment per 
show, or by including additional shows would further de- 
crease the amount of time required to complete the study. 

Discussion 

This study examined procedures and methods to be 
used in a larger prospective study investigating the role 
of psychological states on injury. It required participants 
to complete psychological questionnaires of varying 
length on a daily basis and the 45% recruitment yield 
was higher than anticipated. There were also no drop- 
outs among the artists who agreed to participate, indi- 
cating they found the workload and questionnaires to be 
generally acceptable, with the noted exception of provid- 
ing an overall assessment of well-being. 

Psychological protocols 

To maximize acceptability and participation by the artists 
and their support staff, we used a participatory research 
approach [63]. We sought input from the stakeholder's 
key personnel in both the identification of the theoretical 
model and selection of psychological measures. We used 
an iterative process to ensure we captured all the salient 
features, and to prioritize the traits and states of most 
interest. To minimize dropouts, we targeted specific ques- 
tionnaire completion times based on our previous experi- 
ence in other similar studies, and on the opinions of the 
stakeholder. During the study, we altered the formatting 
and wording of some questions based on participants' 
feedback. 

In general, the majority of artists completed the ques- 
tionnaires within the target time and we obtained data 
on state anxiety, mood, self-confidence, and physical fac- 
tors that will be presented in other reports. From infor- 
mal conversations, some artists were more sensitive to 
nuances within their own psychological states and re- 
quired more time to distinguish among the various 
choices in the questionnaires. For interval validity, the 
artist should be consistent in her/his approach through- 
out the course of the study. We would expect the ac- 
ceptable time to complete questionnaires in other 
activities or sports to be generally similar, but there may 
be important differences based on the participating 
group's culture, and research requirements. Therefore, 
we encourage investigators using protocols that require 
repeated psychological assessments to engage stake- 
holders to build support and determine acceptable ques- 
tionnaire lengths, and other important insights. We 
chose to prioritize our data on the assessment of labile 
states, moods and feelings rather than on distal events 
(e.g. conflict with management, which is a cause of 
mood). We did not include self-efficacy [64,65] because 
the analyses are expected to be confounded by ability, 
and therefore any interpretation would be questionable 



even if it also affects injury risk itself Nor could we ex- 
plore an artist's body awareness (common in dancers), 
and nutrition habits. Although we have data on sleep 
patterns, CDS artists work at night and some regularly 
(or irregularly) take naps; these interim periods of sleep 
could theoretically reduce the effect of a poor night's 
sleep. 

Sample size calculation 

Sample size requirements for a definitive prospective 
study on time loss injuries is prohibitively large, but 
using an MID of 50% increased risk, one could use the 
case-crossover design with prospectively collected con- 
trol data to investigate the role of psychological states by 
following 210 artists for -2-2.5 years for TL-1 injuries, 
and for -3-5 months for medical attention injuries. 
These large sample size requirements (both in number 
of participants, and duration of study which could result 
in subject fatigue) represent an important challenge for 
any study investigating the role of psychological states 
and injury. Sample size requirements would be reduced 
if the injury rate is higher than 10 injuries per 1000 ex- 
posures, the MID is higher than 50%, or the correlation 
of states over time is lower than in our study. 

Our very large sample size calculations appear to con- 
flict with previous prospective studies showing statisti- 
cally significant results for psychological factors as risk 
factors. However, as previously mentioned, there are im- 
portant differences between the studies. First, the TL-1 
injury rate in previous data from our artists was 1.5 in- 
juries per 1000 artist-performances. The injury rates esti- 
mated from the various published studies (assuming 6 
exposures per week per athlete) were approximately 5.1 
injuries per 1000 athlete-exposures (games or practices) 
[37], 6.9 injuries per 1000 athlete-exposures [36], 11.1 
injuries per 1000 athlete-exposures [38], and 4.9 injuries 
per 1000 athlete-exposures [33]. The much higher injury 
rate in elite soccer compared to circus artists in our data 
suggests sample size calculations would be closer to our 
calculated Medical Attention injury definition. Second, 
our analyses address the question whether certain psy- 
chological states are risk factors for injury among partic- 
ipants who get injured (it is not possible to measure the 
effect in those that never get injured). Other published 
studies on psychological states [33,36-38] addressed 
whether psychological factors distinguish between ath- 
letes who get injured and athletes who do not get injured. 
The distinction is important because if the psychological 
state is important in those that get injured, interventions 
for the day of competition or training are promising for 
injury prevention. However, if the psychological state is 
not important in those that get injured and is just a 
marker for a psychological trait, then longer-term inter- 
ventions must be designed to change the more stable 
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psychological traits (if these are indeed causal factors ra- 
ther than markers for true causal risk factors). Third, the 
previous studies compared injured to non-injured sub- 
jects, which is a case-control analysis. Because they did 
not use incidence-density sampling, the results may 
overestimate the effect if adverse psychological states de- 
crease during the study. Finally, previous studies have fo- 
cused on the Daily Hassles questionnaire (measured 
weekly) whereas we focused on daily states related to 
confidence, anxiety and mood. Ivarsson [38] estimated 
the ICC for the Daily Hassles questionnaire to be 73% in 
elite junior soccer players, which is higher than the ICC 
for the variables we report in Table 3. This suggests the 
required sample size would be higher rather than lower 
for questions addressing whether the psychological state 
affects injury risk in those that get injured. 

Although retrospective case-crossover design is pos- 
sible, the risk of recall bias is high. Another alternative is 
to use a hybrid approach where one prospectively col- 
lects "control" exposure data on psychological states 
only once or twice per week, and contrast this with psy- 
chological state data collected for the "case-event" after 
the injury occurred. In this study design, some of the 
cases would happen to occur on days where pre- 
performance exposure data had already been collected. 
Thus, one could estimate the magnitude of "case" recall 
bias by comparing exposures collected retrospectively 
after the injury with exposure data collected prospect- 
ively before the performance. There is research demon- 
strating athletes can provide accurate retrospective 
reports on past performances, at least for anxiety and 
pre-performance moods [40]. 

Finally, recent technological advances allow data to be 
entered directly via smartphones and tablets. Although 
these methods may appear promising, surveys on elec- 
tronic devices are sometimes read/ interpreted differently 
from paper-based systems, and response rates may or may 
not be improved [66-68] . Investigators should evaluate the 
advantages and disadvantages of all methods within the 
context of their study. 

Conclusion 

We found that that the procedures used to implement 
systematic psychological monitoring of CDS artists were 
successful with respect to time to complete, distribution, 
acceptability and comprehension of questionnaires. The 
same methods could be implemented in other sport con- 
texts where injury and exposures are closely monitored, 
and participants have their personal reserved space (e.g. 
in a dressing room) to receive and complete question- 
naires. Challenges for recruitment and retention were 
primarily related to the degree of willingness to repeat- 
edly complete questionnaires. Additional challenges in- 
clude optimal questionnaire formatting, prioritizing which 



psychological constructs to study, and the limited number 
of questions due to time constraints. Finally, in the popu- 
lation studied, sample size calculations suggest several 
years of follow-up would be necessary to measure states 
that change daily given the injury rates. Sample sizes 
would be lower if injury rates were higher, or correlations 
between daily states lower. 

Additional file 



Additional file 1: Daily questionnaire. 
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